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ABSTRACT 

This investigation mapped the correspondence between 
indicators at the post-school level included in the comprehensive 
system of educational outcomes and indicators developed by the 
National Center for Educational Outcomes (NCEO) and indicators 
included in select national data collection programs. The NCEO model 
articulates outcomes and indicators seen as appropriate for all 
students, including students with disabilities. The study found that 
approximately one-half of important post-school outcomes for all 
students are represented in 10 national data collection programs. On 
the average, there was less than one national data collection program 
represented per outcome indicator . Post-school outcome indicators for 
students with disabilities were less available than those found at 
the school completion level . Recommendations are provided to revise 
national data collection programs in order to produce useful 
policy-relevant information regarding post-school completion outcomes 
for students with disabilities. They are: attention needs to be 
directed to the development of indicators in all NCEO post-school 
outcome domains ; the NCEO conceptual model of outcomes should be 
reviewed for ideas on new outcomes or indicators to include in 
ongoing or future national studies; individuals and organizations 
developing instrumentation for national data collection programs 
should review the instruments and methodology reports of the National 
Longitudinal Transition Study of Special Education (NLTS) for ideas 
on how to develop strategies for measuring outcomes for all students. 
The following data collection programs were evaluated: (1) NLTS; (2) 
National Adult Literacy Survey; (3) National Household Education 
Survey; (4) National Health Interview Survey; (5) National . Survey of 
Family Growth; (6) National Crime Survey; (7) Current Population 
Survey; (8) National Household Survey on Drug Abuse; (9) Monitoring 
the Future; and (10) National Longitudinal Alcohol Epidemiologic 
Survey. Figures and tables present the NCEO model and the mapping of 
outcomes/indicators with the data collection programs. (Contains 26 
references.) (DB) 
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Abstract 



lefonn initiatives are shifting the focus toward outcomes and quantifiable data 
and, with increasing firequency, are being evaluated using data drawn from the nation’s existing 
Hata collecticm prograius. Tl^ investigation mq>ped the correspondence betweOT indicators 
included in the NCEO conqrehensive system of Educationa l Outcomes yid Indicators for 
TnHiviHnals at Ae Post-School Level and indicators included in select natirmal data collection 
programs. We found that ^proximately one-half of important post-school outcomes for all 
students are represented in ten naticmal data collection programs. On the average, Acre was less 
than one natinnal data collection program represented per outcome i^cator. Additional analyas 
showed that post-school outcrane indicates for students wiA disabilities are less available than ^ 
Aose found at the school completion level. These findings, togeAo: vdA Ac signifi^t exclusion 
of students wiA disabilities data collection programs and Ac variable or nonexistont 

identificatioit of such students in Ac final data sets, mean that it is all but impossible to produce 
conqnehensive rqports about Ac status of students wiA AsaWlitics. Rccommend^ons are 
provided to revise naticHial data collection programs m wder to produce useM policy-relevant 
information regarding post-school ccanpletion outcomes for students wiA disabilities. 
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Matching Information in National Data Collection Programs 
to a Model of Post-School Outcomes and Indicators 

The National Center on Educational Outcomes (NCEO) for students with disabilities wp 
established in October, 1990 to work with state departments of education, national policy-making 
groups, and others to facilitate and enrich the development and use of indicators of educational 
outcomes for students with disabilities. It is believed that le^nsible use of indicators will enable 
students witii disabilities to achieve better results fircmi their educational experiences. 

One (rf the four major strategic goals of NCEO is to enhance the availability wd use of 
outcomes informatiai in decision imking at federal and state levels. A variety of activities ate 
subsumed under this goal. Two of the activities focus on reviewing the characteristics of major 
data sets in the national education data system as a prelude to secondaty analysis of the d^ sets. 
The purpose of these activities is to determine the feasibility of extracting quality and cre^ble 
policy-relevant information on the educational status and pmormance of students with disabilities 
(McGrew, Spiegel, Thurlow, Ysseldyke, Bruininks, & Shriner, 1992). The results of this critical 
review process will contribute to the NCEO strategic goals by: 

1 . Determining the extent to which the current national data collection programs 
ccMisider st^ents with disabilities when planning and implementing data collection. 

2. Reviewing the extent to which students with disabilities are included or excluded in 
national £ta collection programs as a result of sample design and 
inclusion/exclusion procedtures. 

3 . Reviewing the inclusion and exclusion procedures used in national data collection 
programs. 

4. Determining the depth and breadth of outcomes included in national data collection 
programs and the extent to which these outcomes approximate a conceptual model 
for a comprehensive system of indicators. 

5 . Reviewing the means by which national data collection programs describe the 
functional characteristics of students with disabilities. 



Secondary data analysis will be completed using existing data. It is hoped that the results 
of the review process indicate that sufficient quality data exist in the nation's data collection Systran 
to support credible analyses. The completion of these analyses will contribute to other NCEO 
strate^c goals by providing infonnation to include in the NCEO synthesis rqxuts on the 
educatioiik outcomes of c^dren and youth with disabilities. 

NCEO findings related to the &st three goals listed above have been reported ^cGrew, 
Algozzine, Spiegel, Thurlow, & Ysseldyke, 1993; McGrew, Thurlow, Shriner, & Spiegel, 1992; 
McGrew, Thurlow, & Spiegel, 1993). 6 addition, the extent to which the indicators included in 
the NGEO comprehensive system of Educational Outcomes and Indicators for Students 
Completing School (Y sseldyke, Thurlow, & Gilman, 1993a) (Goal number 4) has already been 
reported (McGrew et al., 1994). This report focuses ot additional NCEO activities related to goal 
nundirar four; the extent to which the indicators included in the NCEO conquchensive system of 
Educational Outcomes and Indicators for Individuals at the Post School Level (Ysseldyke, 
Thurlow, & Gilm^ 1993b) are included in national data collection programs. The purpose of this 
activity is to: (a) highlight potential gaps in the current national edutatira data collection system, a 
system that has not had the benefit of evolving fiom an a priori conceptual model, and (b) provide 
an organizational fiamewOTk firom which to conduct secondary analysis (McGrew, Spiegel, et al.. 
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1992). The identification of information gaps in the current data collection system may serve to 
stimulate the modification of current data collection programs. It also may stimidate the 
develc^ment of new data collection programs that provide for naosre comprehensive conceptually- 
based national data. Hopefully, such data will provide useful, policy-relevant information for ^ 
children. 



The Current Context: Measurement-D riven Education Reform 

Our nation is becoming "increasingly dependent on statistics for policy analysis and 
deci^on making" (Andrew, 1984, p. 51). Furthermore, "schcxil reform has riveted national 
attention on the numbers" (Hanford & White, 1991). Reform initiatives throughout the entire 
educational system arc shitog the focus tow^ outcomes and quantifiable data. Witii increasing 
fiequency, the data needed to monitor and evaluate these reforms are being drawn fiom databases 
in the nation's existing education data collection system. 

The cnirrent national goals and educational indicators movements have produced a flurry of 
ac^vity to identify databases that inclu^ indicators to help monitor progress toward goal 
attainment The Specdal Study Panel on Educational Indicators (IWl) reported that the success of 
educational reform depends on the develc^ment of a "con^rehensiye education indicators 
information system Capable of monitoring the health of the enterprise, identifying problems, and 
illuminating foe road rfoead" (p.6). S imilar calls fee foe improvement of foe existing national 
education d ata system and foe cievelopment of new components to include in foe system have been 
echoed in reports by the National Education Gc^ Panel (1991a) and foe National Education 
Statistics Agenda Committee of foe National Forum on Education Statistics (199()). Each of these 
groups has turned toward national data <x>Uection programs for indicators to monitor progress 
during the current wave of reform. 

For example, in its report Measuring Progress T ciward foe National Education Goalsi 
Pntftnrial Indicators ^d Measurement Strategies, foe National Education Goals Panel (1991a) 
reports on how to measure progress toward the six naticmal education ^als by recommending foe 
use of indicators from such data sets as foe National Educational Longitudinal Study (NELS) and 
foe National Assessment of Educational Progress (NAEP). The National Education Statistics 
Agenda (liommittee (19W) also recommend^ using indicators fimn NELS and NAEP, as well as 
other data sets, to itrqnove foe data provided by foe national education data system. Other groups 
looking for indicators from existing national databases as a means to measure progress of children 
and youth include foe Council of Chief State School Officers, Joining Forces (a coalition of foe 
American Public Welfare Association and foe Council of Chief State School Officers), Kids Cpunt 
( Anni e. E. Casey Foundation 1995), and NCEO, to name but a few. 

In addition to foe general education reform movement, recent reform mitiatiyes in speaal 
education (Skrtic, 1991) are producing increased interest in analysis of existing national databases. 
Since foe passage of PL 94-142 in 1975, there has been over a decade of evtduation studies that 
have focused primarily on the issue of educational access for scents with di^bilities and ^ 
irrplementation of foe processes embodied in foe law. Increasingly foe question of "where's foe 
beef?" has been asked from both within and outside of Sj^ial education. Focus h^ recently 
turned toward evaluating foe outcomes of special education, or, "where's foe data?" on 
effectiveness (DeStefano & Wagner, 1991). 
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The NCEO Conceptnal Model of Outcomes And IndicatCHS 

Secondary analyses of large extant databases "have enormous potential for policy analysis 
and evaluation research" (Meyers & Rockwell, 1984, p. 5) and such s^yses are on the increase. 
Analysis of indicators from national education data sets have produced policy-relevant reports such 
as NCES's The Condition of Education. OERl's Youth Indicators. Hispanic Education: A 
Statistical Portrait 1990 (De La Rosa & Maw, 1990), the 1990 C3iaitbook: Services for People 
with Disabilities (A mado. Lakin, & Menke, IS^), and the annual National Education Goals 
Report (National Education Goals Panel, 1991b, 1992, 1993, 1994, 1995). These and other 
similar rq>orts have as their major thrust the communication of mfornaaticm to critical decision 
makors in the policy arena. Such policy-relevant reports are only possible through the secondary 
analysis of a numb^ of data sets. 

An eight st^ process is used to guide NCEO secondary analysis activities (McGrew, 
Spiegel, et al., 1992). The second stq> in this process is the development or use of a concepmal 
firework to guide the analyses. A conceptu^ framework serves to guide the analyses and insure 
that the informational needs and research questions are answered (DeStefano & Wagner, 1991). 

The NCEO Concq>tual Model of Outcomes (Ysseldyke et al., 1993b) is serving this 
purpose for the NCEO secondary analysis activities. The NCEO model was designed to reflea 
outcomes that apply to all students, not just students with disabilities. Hundreds of educators, 
policymakers, and parents participatai in a stractured consensus building process (Vanderwood, 
Ysseldyke, & Thurlow, 1993) that resulted in the current model (CHlman, Thurlow & Ysseldyke, 
1992; Ysseldyke et al., 1993b). The NCEO Post-School Conceptual Model of Outcomes is 
presented in Figure 1. 

The conceptual framework depicted in Hgure 1 shows the complete educational model, 
with Educational Resources (Inputs and Contexts) influencing Educational Opportunity and 
Process. These in turn, influence Outcome Domains, which have a return influence on both the 
resources and opportunity/process. The inclusion of two of the outcome domains (i.e.. Presence 
and Participation; Accommodation and Adaptation) in the model has been controversial. At the 
post-school level, outcomes in the Accommodation and Adaptation domain were viewed by 
stakeholders as integrated within aU other domains. The unshaded diamond indicates that this 
domain is not measured separately at the post-school level. A detailed discussion of issues 
surrounding the development and ongoing refinement of the NCEO irxxlel is presented in 
Ysseldyke et al. (1993b). 

The concqptual model is extended by the identificaticm of outcomes within each outcome 
domain and indicators of the respective outcomes. Outcomes are the results of interactions 
between the students and the education system. Indicators ate numbers c»r other symbolic 
representations that can be tised to determine whether desired outcomes are achieved. Figures 2 
through 9 present the outcomes and outcome indicators for each outcome domain for the NCEO 
model developed for individuals at the post-school level (Ysseldyke et aL, 1993b). 



The outcomes and indicators presented in Figures 2 through 9 served as the basis for the 
analyses summarized in this report. TTiis investigation mapped the correspondence between the 
indicates of outcomes in the NCEO post-school irxxlel and irxlicators contained in recurring 
national data collection programs. 
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Figure 1. Design of Domains, Outcomes, and Indicators in Model 
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Figure 2. 



= OUTCOME 



Presence 




s INDICATOR 



iticipation 




i* in community 



A Peirrat of individuals living in uvular conununity 
settings (differentiated by type - living with 
paients/&mily of origin, semi-indq)endent residence, 
independently) 



A Percent of individuals in postsecondary schooling 

(differentiated by type - 4 year college, 2 year college, 
vocational training, adult basic education) 




Participatas In 
community 






Percent of individuals regularly participating in 
conununity-based activities, groups, and (sganizations 




Is smployad 




Percent of individuals in the woric force (differentiated by 
fuU-time, part-time, homemaker) 



▲ Percent of individuals whose employment is partially 
subsidized by non-emptoyer fun^ 
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Figure 3. 

^ s OUTCOME 




Adaptation 



A s iNOICATOR 



Outcomes and indicators in this domain were considered during the consensus- 
building process. Pardcipants recommended that no separate outcomes be identified in 
this domain at the Post-School level. Rather, outcomes and indicators reflecting 
accommodation and adaptation should be incorporated within other domains. 

This domain was considered very important at earlier developmental levels. For 
example, at the School Completion level stakeholders identified two important 
outcomes in this domain: 

• Makes adaptations, accommodations, or compensations necessary to achieve 
outcomes in each of the major domains 

• Demonstrates family support and coping skills 

Readers should refor to the document entitled Educational Outcomes and Indicators 
for Students Completing School to see the kinds of indicators stakeholders identified in 
this domain. 
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Figure 4. 
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care needs 



Percent of individuals who know when, where, and 
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emergency health cate procedures 




Is physically fit 
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Figure 5 . 
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A = INDICATOR 
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Gets about in the 
environment 




Percent of individuals who can get to and from a variety 
of destinations 



Percent of individuals who know how to access 
conununity services (e.g., rehabilitation, counseling, 
employmrat, health, etc.) 



Percent of individuals who complete transactions 
(shotting, banking, drycleaning, etc.) in the community 




is responsible for seif 



Percent of individuals who can prioritize and set goals 
and persevere toward them 



Percent of individuals who manage personal care and 
safety 




Percent of individuals who effectively advocate for 
themselves 




Functions independently 



A Percent of individuals who make their own choices or 
exercise self-determination 

A Percent of individuals who obtain basic life necessities 
(e.g., housing, food, work, social relatioaships) 

A Percent of individuals who are engaged in productive 
daily activities (e.g., hold job, perform community 
service) 
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Fi^ 6 . 

S OUTCOME 




▲ S INDICATOR 



Contribution^a Citizenship 




Compiieswith 
community ruies 



A Percent of individuals convicted in the aiminal justice 
system or courts 




Votes 



A Percent of individuals who vote 
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A Percent of individuals who volunteer time to help others 
and improve community resources duou^ school, civic, 
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Percent of individuals who pay taxes 
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Figure?. 

^ = OUTCOME 
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ional Literacy 



A = INDICATOR 



Dftmonstrates competsncs in 
communication 




Damonstratas oompatence in 
probiam-aolving strategioa 
and crKicai thinking akilis 



A Percent of individuals who use and comprehend language 
that effectively accomplishes the purpose of the 
communication 



A Percent of individuals who demonstrate competence in 
listening and comprehending language necessary to 
funetkm in their home, school, woric, and community 
environments 



A Percent of individuals who demonstrate problem-solving 
and critical thinking skills 




Demonstrates competence 
In math, reading and writing 
skills used in daily life 



A Percent of individuals who demonstrate competence in 
math necessary to function in their current home, school, 
work, and conununity environments 

Jk Percent of individuals who demonstrate competence in 
jhL reading necessary to function in their current home, 
school, woric, and community environments 

""" .gm Percent of individuals who demonstrate competence in 

writing necessary to function in their current home, school, 
woric, and community environments 

Percent of individuals who read the newsptq)er 
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Percent of individuals who demonstrate home 
management skills 

Percent of individuals who demonstrate money 
management skills 
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Percent of individuals who demonstrate ability to deal 
with community agencies 

Percent of individuals who identify, organize, and allocate 
non-monetary resources effectively (e.g.,time, m ate ri als, 
space, human resources) 



Percent of individuals who currently apply technology to 
enhance functioning in home, school, work, and 
community environments 
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£i£UI^. 

= OUTCOME 
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Percent of individuals who cope effectively with 
posonal challenges, frustrations, and stressors 



Percent of individuals whose behavior reflects 
an accq>tance the consequences for behavior 
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Percent of individuals who exercise self-control 
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A Percent of individuals who perceive 
themselves as worthwhile 



A Percent of individuals who poiceive 
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Percent of individuals who have friends and are a 
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Percent of individuals who demonstrate skill in 
interacting in social situatioits 
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managing interpersmtal conflict 
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Figure 9. 
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▲ S INDICATOR 




Individuar* satisfaction 
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A Percent of individuals who are satisfied with their 

current status and life experiences (e.g., general well 
being) 

A Percent of individuals who are satisfied with what 
was provided in postsecondary school experiences 

A Percent of individuals who are satisfied witii their 
current employment experience 
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Method 



Selection of Data Collection Programs 

Ten national data collection programs were analyzed in the current investigation. These 
data cdlection prograrns represent a subset of 28 nation^ data collection programs identified by 
NCEO as being potentially useful in the extraction of policy-relevant information on the educational 
status and performance of students with disabilities (McGrew, Thurlow, et al., 1992). The 
complete set of 28 data collection programs was targeted based on each program’s: (a) potential 
usefulness in providing indicators of outcome domains in the NQEO conceptual model of 
educational outcomes for children and youth with Usabilities (Ysseldyke et aL, 1993b), and (b) 
prominence in current efforts to monitor progress toward the attainment of national education 
goals. 



The ten data collection progranis included in the current investigation are briefly described 
in Table 1. Since the purpose of this investigation was to determine the extent to which the NCEO 
post-school outcorioes and indicators are included in recurring national data collection programs, 
only those data collection programs that currently occur, or are planned to occur, on a regular b^is 
were selected. In addition, ordy those data collection programs that included in^viduals of post- 
school age were included. 

For example, the National Household Education Survey (NHES), Current Population 
Survey (CPS), and National Health Interview Survey (NHIS) are data collection programs that 
occur on a regular basis and include individuals of this age group in their samples. These three 
data collection programs w«e included in this study. This contrasts with other data collection 
programs that may contain important outcomes and indicators but are not recurring programs. 

There was one exception to the above selection criteria. The National Longitudinal 
Tranation Study (NLTS) of Spet^ Education Students was the exceptitxi. Although a fixed 
duration longitudinal data collection program, NLTS represents the first large-scale national survey 
of students with disabilities. It is inqxatant to determine the extent to which s imilar specialized 
national data collection programs of the future, or other data collection prog rams that mi gh t 
incorporate some of NLTS's variables, result in broader coverage of the NCEO outcomes and 
indicators. The National Educational Longitudinal Study of 1988 (NELS:88), which gathered 
post-school information, could not be included due to the lack of a published technical or 
methodology rq>ort for the third follow-up at the time of this investigation. 

The relevant methodological and technical reports for each data collection program were 
obtained fircxn the sponsoring agency. The section of each data collection program's codebook or 
user manual that presented the assessment instmments served as the source d^uments fm* the 
subsequent analyses. 

Analysis of Data Collection Programs 

The individual itetrls in each data collection program's assessment instruments were 
compared to each NCEO outcome and outcome indicator listed in Figures 2 through 9. The goal 
wcs to identify assessment items that corresponded closely to the NQEO outcome indicators. If 
one c; i jore survey items in a data collection instrument were judged to be a close match to an 
NCEO outcome indicator, the data collection program was classified as providing potentid 
indicators for that outcome in the NCEO Ck>nceptual Model. Two individuals coniplet^ this 
review process for each data collection program. 
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Table 1 . Descriptions of National Data Collection Programs Included in Investigation 



Narional Longitudinal Transition Study of Special Educatio n Students 
(Dqjartmcnt of Education)-NLTS:90 

A nationally representative longitudinal study of special education students who were in grades 7-12 during 
die 1987 base year sample. By coOecdng a wide array of information fiom parents/guaidians, school records, and 
school administrators, this data collection program juovides descriptive information regarding the transition cS. jwith 
with rfigahilftiftg from secondary school to early adulthood, and seeks to identify factors diat contribute to effective 
transition of youth with disabilities. The first follow-iQ) was completed in 1990. 

National Adu lt Literacy Survey 
(pqjaitment of Education)-NALS:92 

A nationally rqpresentative cross-sectional study designed to collect infrHmation on the types and levels of 
literacy dnltg of adults and how these skills are distributed across major subgroups. This study assessed the prose, 
document, and quantitative literacy of young adults in 1992. 

National Household Education Survey 
(Dqpartment Education)-NHES:91 

A nationally representative cross-sectional sample of households was surveyed in 1991 to provide national data 
regarding early and adult education issues, The 1991 base year survey targets information on the care and education 
of 3-u>-8 year old children, and the participation of adults in education activities. 

National Health Interview Survey 

(Dqpartment of Health and Human Services)-NHIS:91 

A nationally rqweseiuative oross-secticnal study designed to provide informatirm on the health of the civilian 
nnningritiirinnaliTft d IT S- population (birth through adulthood!. This survey has been completed annually since 
1957. While the same basic demograi^ and health-related information is collected each year, additional information 
on special health topics (e.g., AIDS, aging, etc.) may be covered in any one survey. 

National Survey of Family Growth 

(Department of Health and Human Services)— NSPG:86 

A nationally representative cross-sectional sample drawn fiom households involved in the National Health 
Interview Survey (NHIS). The 1986 cycle included women fiom 15-44 years of age who where included in the 1986 
NHIS. The study ptovit^ national data on the demographic and social factors associated with childbearing, 
contraception, adopdmis, and maternal and child health. 

National Cri me Survey 
(Dqiartment of Justice)-NCS:86-89 

A nationally representative cross-sectional sample (collected on a three year cycle) (rf household members age 12 and 
above. The study is designed to collect data on personal and household crime victimization. 

Current Population Survey. March Supplement 
(Dqiartment of Comm©tce)-CPS 

A nationally representative cross-sectional study designed to collect infeumation on the employment situation 
and demographic status of the complete U. S. population (bhth through adulthood). 'The March Supplement is 
specifically designed to gather data on work experience, income, noncash benefits, and population migration. Data 
collection in this program has been occurring aimually since the 1940s. 

National Household Survey on Drug Abuse 
(Department of Health and Human Scrvices)-NHSDA:93 

A nntin natly r^uesentative cross-sectional study designed to collect information on the use of tobacco, 
alcohol, illicit drugs, and iKMunedical use of prescription drugs. Data collection in this program has been occurring 
. on a biennial basis since 1971. 
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Table 1. continued Descriptions of National Data Collection Piogranis Included in Investigation 



Monitoring flie Future 

(Dqiaitinent of Health and Human Services)-MF:94 

A nationally representative kmgitudhial study designed to collect infonnation on drug use and attitudes about 
diu^, views about personal lifestyles, confidence in social institutions, intergioup and inteipersonal attitudes, 
amceiTLS about conservation and ecology, and other social and ethical issues. High school seniors have been the base 
year sample fOT diis annual survey since 1975. Follow-up surveys are conducted annually for each class for iq> to 
fourteen years. 

National Longitudinal Alcohol Epidemiologic Survey 

(Dq)artment of Health and Human Services) - NLAES:92 

A natitmally representative longitudinal study of individuals 18 years of age and older. The study is 
designed to determirte the incidence aixl prevalence of alcohol use disorders and thdr associated disabilities. 



As is often the case, the variables and indicators of concepts included in data collection 
programs typically do not provide an exact match to the indicators needed for secondary analysis 
(McGrew, Thurlow et al., 1992). Given that secondary analysts must often use less than perfect 
"surrogate" measures that were originally developed for different purposes, conceptually similar or 
approximate indicators were considered to be a "match" with an NCEO outcome, when so judged 
by group consensus. Discr^ancies between the reviewers were resolved by group consensus, 
and/or by review by a third individual. A more detailed discussion with exarq>les can be found in 
McGrew, Spiegel, Thurlow, & Kim (1994). When difficult model-indictor mapping decisions 
ware necess^, the final criterion us^ to make judgments was whether the NCEO staff would feel 
comfortable in using the variables as proxies for the NCEO outcome indicators in secondary data 
analysis. 



Results 

The results of the mapping process are presented by NCEO Post-School outcome domains 
in Tables 2 through 8. 

In the NCEO domain of Presence and Participation, each of the five NCEO indicators is 
present in at least one of the data collection programs reviewed (see Table 2). The indicator 
representing employment partic^ati<»i (A3a) was jnesent in all ten data coUectitm progra^. 

Given that post-school en^loyment has been the focus of much research, it is not surprising that 
the cn^loyment indicator was present in all the reviewed databases. Participation in ^stsecondary 
schoolhig or training (Alb) was next in frequency (present in four of the tai data collection 
pre^rams). With the one exception of the WDF:94 d^ coUectiem program, the three remaining 
indicators (Ala, A2a, A3b) were only p^ent in NLTS:90, a sj^al purpose and ncm-recurring 
data collection program focused just on individuals with disabilities. 

Eight of the ten (80%) NCEO Physical Health indicators had measures available (sec Table 
3). 'V^^th the exception of inrheators in four data collection programs for "percent of individuals 
who have abused alcc^ol or drugs in the past year" (Clb), most of the accounted for indicators 
were present in two to three data collection programs. Indicators reflecting awareness of first aid 
and emergency health care procedures (C2c) and when, where, and how to access health care 
(C2d) were not present in any of the reviewed data collection programs. Not surprisingly, two 
data collection programs sponsored by the Department of Health and Human Services (NHIS:91; 
MF:94) providM the broadest coverage (seven of the ten) of the Physical Health outcome indicator 
domain. 
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Table 2. Mapping of NCEO Post-School I^vel Presence and Participation Outcomes and 
Indicators with Select National Data CoUection Programs 



1 


Data Collecticm Programs* 




^^^t^m^/Indicators 


NLTS 


NALS 




NHIS 


NSFG 


NLAES 


NCS 


CPS 


NHSDA 


mfI 


90 


92 


_2LJ 


91 


86 


92 


86-89 




93 


94 1 


1 Alls in community 1 


(a) P^cent of individuals living in 
regular communitv setdnes 


X 




















0>) Percent oi individuals in 
postsecondary schooling 


X 


X 












X 


1 


X 


li A2 Participates in community I 


II (a) Percent individuals regularly 
II paiticipataig in community-based 

1 activities, groups, and organizations 


X 


















IJ 


il A3 Is Emoloved -1 


00 Percent of individuals in the 
workforce 


X 


X 


X 


X 


X 


X 


X 


X 


X 


X 


(b) Percent of individuals whose 
employment is partially subsidized 
by non-employer funds 


X 





















* NLTS: 90 = National Longitudinal Transition Study of Special Education Students, 1990 Follow-up 
NALS: 92 = Natiwial Adult Literacy Survey (1992) 

NHES: 91 = National Household Education Survey (1991) 

NHIS: 91 = National Health Interview Survey (1991) 

NSFG: 86 = National Survey of Family Growtii (198Q 
NLAES: 92 = National Longitudinal Alcohol Epidemiologic Survey 
NCS: 86-89 = National Crime Survey (1986-89) 

CPS = Current P<q>ulation Survey 

NHSDA: 93 = National Household Survey of Drug Abuse (1993) 

MF :94 =: Monitoring the Future (1994) 



Note: "X" indicates database includes a possible indicator. 
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Table 3. Mapping of NCEO Post-School Level Physical Health Outcomes and Indicators with 
Select Nadoi^ Data Collecdon Programs 



Data CollectitMi Programs* 


Outcoices/Indicatars 


NLTS 

90 


NALS 

92 


NHES 

91 


Nms 

91 


NSFG 

86 


NLAESI 
92 1 


NCS 

86-89 


CPS 


NHSDA 

93 


MF 

94 


C 1 Makes healthy lifestyle 
choices 






(a) Percent of individuals who make 
good nutritional choices 








X 












X 


(b) Percent of individuals who have 
abused alcohol or drugs in the past 
year 








X 




X 






X 


X 


(c) Percent individuals >\4io indicate 
they have had unprotected sex in ths 
past year 








X 


X 












(c9 Percent of individuals who elea to 
participate in sports, recreation, 
and/or exercise activities 


X 






X 












X 


C2 Is aware of basic safety, 
ntness, and health care needs 


(a) Percent of individuals who ate aware 
of basic safety precautions and 
nroceduies 


X 


















X 


G>) Percent of individuals who ate aware 
of basic fitness needs 








X 












X 


(c) Percent of individuals who are aware 
(tf bask health care needs 








X 












X 


(dO Percent of individuals who know 
when, where, and how to access 
healthcare 






















(e) Percent individuals who are aware 
of first aid and emergency health care 
proceduies 






















C3 Is physically Ht 


(a) Percent q£ individuals who are 
physically fit 








X 










X 


X 



Note . "X" indicates database includes a possible indicator. 

*See Table 2 for identificatioa of data ccdkctitm programs. 
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WiA the exception of nine of the ten data collection programs including an indicator of 
involvement m productive daily activities (D3c-see Table 4), the outcome domain of 
Responsibility and Independence was unrepresented in the reviewed national data collection 
programs. Tte one remaining indicator ("poccent of individuals who can get to and from a variety 
of destinations”-Dla) was only present in NLTS:90, a non-recurring national data collection 
program. Thus, eight of nine (89%) of the NCEO Responsibility and Independence outcome 
indicators were not present in &e recurring national data collectitm programs reviewed in this 
investigation. 

In the domain of Contribution and Citizenship, three of the four indicators (75%) had 
measures available in two to three data collection programs (see Table 5). Payment of taxes (E4a) 
as an indicator of Contribution and Citizenship was not present in any of the ten reviewed data 
collection programs. In contrast, die Academic and Functional Literacy domain was very under- 
repre^ted across the ten data collection pr ograms (see Table 6). Five of the thirteen academic and 
functional literacy indicators were available only through NALS:92, with one additional indicater 
(F4b) being present in NLTS:90. No indicators of the subdomains of problem-solving strategies 
and critical thinking skills CP2) (x* the use of technology (F5) were located in any of the data 
collection programs. 

In the domain of Personal and Social Adjustment, seven of the eight indicators (88%) were 
present in at least one data collection program (see Table 7). Most all of tiiese indicators were 
found eitiier in the non-recurring NLTS:90 or MF:94 data programs. When the non-recurring 
NLTS:90 data collection program is excluded from consideration, eight of the thirteen (61.5%) 
Perscmal and Social Adjustment intticators are not represented in recurring national data collection 
prograrns. No coverage is found for the subdomains of effective coping with personal challenges, 
frustrations, and stressors (Gl). 

Rnally, the NCEO domain of Satisfaction is (with one exception) not measured in the 
current sarr^le of national data collection programs (see Table 8). A sole indicator was found that 
could serve as a proxy for an individual’s satisfaction witii his or her current status and life 
expmences (Hla). 

Table 9 presents a summary of the availability of NCEO Post-School Completion outcome 
indicators across the reviewed data collection programs. Overall, the coverage is nxxierate, with 
57% of the NCEO indicators represented in at least one of the ten data collection programs 
reviewed. When the NLTS drua collection program (the only program specifically focused on 
individuals with disabilities) is excluded from tire table, this percentage drc^s to under half (46%). 
The databas^dicator ratios presented in Table 9 indicate that tire breath of coverage (average 
number of data collection progrtens per indicator) is tire greatest in the NCEO post-school outcome 
domains of Presence and Participation (2.0) and Physidd Health (2.0). The outcome domains of 
Contribution and (Citizenship and Personal and SocM Adjustment have half the breadth of coverage 
(i.e., database to indicator ratios of 1.0) of Presence and Participation and Physical Health. The 
domains of Re^nsibility and Independence, Academic and Functional Literacy, and Satisfaction 
are poorly represented by average database to indicator ratio values of 0.0. 
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Table 4 . Mapping of NCEO Post-School Level Responsibility and Independence Outcomes 
and Indicators wiA Select National Data Collection Programs 





Data Collection Programs'" j 


uutcomes/Indicators 


NLTS 

90 


NALS 

92 


NHES 

91 


Nms 

91 


nsfgI 

86 


NLAESl 
92 1 


NCS 

86-89 


CPS 


NHSDA 

93 


MF 

94 


D1 Gets about in the environment 




(a) Percent oi individuals who can get 
to and fimn a variety of destinations 


X 




















(b) Percent of individuals who know 
how to access community services 
(e.g., rehabilitation, counseling, 
employment, health, etc.) 






















(c) Percent oi individuals who complete 
transactions (shopping, banking, 
dry-cleaning, etc.) in the community 






















D2 Is responsible for self 


(a) Percent of individuals who can 
prioritize and set goals and persevere 
toward diem 






















(b) Percent of individuals who manage 
perstmal care and ^ety 






















(c) Percent of individuals who 

effectively advocate for themselves 






















D3 Functions independently 


(a) Percent of individuals who make 
their own choices or exercise self- 
determinadon 






















(b) Percent of individuals who obtain 
basic life necessities (e.g., housing, 
food, wodc. social relationships) 






















(c) Percent individuals who are 
engaged in |»oductive daily activities 
(e.g., hold job, perform community 
service) 


X 


X 


X 


X 


X 




X 


X 


X 


X 



Note. "X" indicates database includes a possible indicator. 

'"See Table 2 for identification of data collection programs. 
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Tables . Mapping of NCEO Post-School Level Contribution and Citizenship Outcomes and 
Indicators with Select National Data Collecticxi Programs 



1 


Data CoUeetkm Programs* 






Outoxnes/Indicators j 


NLTSll 

90 


nalI 

92 1 


^^9f| 


Nms 

91 


NSFC 

86 


NLAES 

92 


NCS 

86-89 


CPS 


NHSDAl 
93 1 


MF 

94 


El Complies with community 
rules 


(a) Percent ai individuals convicted in 
the criminal justice system (V courts 


X 
















X 




E2 Votes 


Percent of individuals who vote 


X 


X 
















X 


E3 Volunteers 


Percent of individuals who 
volunteer time to he^ others and 
improve community resources 
through school, civic, community, 
(X nonprofit activities 


X 


X 
















X 


E4 Pavs taxes 


(a) Percent of individuals who pay taxes 























Note. "X” indicates database includes a possible indicator. 

*See Table 2 for identification of data collectirm programs. 



Table 6. Mapping of NCEO Post-School Level Acadenuc and Functional Literacy 
Outcomes and Indicators widi Select National Data CoUectitxi Programs 





Data Collection Programs* 




Outcomes/Indicators 


NLISlNALSi 
90 I 92 I 


NHE 

91 


NHIS 

91 


NSF<3 

86 


NLAES 
92 1 


NCS 

86^1 


CPS 


NHSDA 

93 


"mf 

94 


FI Demonstrates competence in 
communication 


(a) Percent (rf individuals who use and 
cemprebend language tiiat 
effectively accomplishes the 
purpose of the communication 




X 


















(bjPercentctfindividualswbodenKX)- 
strate competence in listening and 
comprehending language necessary 
to fimedon in their home, school, 
wcric, and community environments 






















F2 Demonstrates competence in 
problem-solving strategies 
and critical thinkins skills 


00 Percent of individuals who 
demonstrate problem-solving and 
critical thiitidna skills 
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Tabig continued. Mapping of NCEQ Post-School Level Academic and Functional 
Literacy Outcomes and Indicators with Select National Data Collection Progtams 





Data Collection Programs'*' | 


Outcomes/Indicators 


NLTS 

90 


NALS 

92 


NHE 

91 


NHIS 

91 


NSFG 

86 


NLAES 

92 


NCS 

86-89 


CPS 


NHSDA 

93 


MF 

94 


F3 Demonstrates competence in 
math, reading and writing 
skills used in dailj' life 


(a) Percent of individuals who 
demonstrate competence in math 
necessary to function in their 
current home, school, work, and 
conununitv environments 




X 


















(b) Percent of individuals who 
demmstiate competence in reading 
necessary to function in their 
current home, school, work, and 
community environments 




X 


















(c) Percent of individuals who 
demonstrate competence in writing 
necessary to function in their 
current home, school, worit, and 
community environments 




X 


















(cD Percent of individuals who read the 
newspaper 




X 


















F4 Demonstrates competence in 
other academic and non* 
academic skills 


(tO Percent of individuals who demon- 
strate home management skills 






















(b) Percent of individuals who demon- 
strate money manaeement skills 


X 




















(c) Percent of individuals who demcxi- 
strate emnlovability skills 






















(d) Percent of individuals who 
demonstrate ability to deal with 
community asencies 








, 














(e) Percent of individuals who identify, 
organize, and allocate non- 
monetary resources effectively 






















F5 Demonstrates competence in 
usine technoloev 


Percent of individuals who currently 
apply technology to enhance 
fimctioning in home, school, w(^ 
and community environments 























Note . "X" indicates database includes a possible indicator. 

*See Table 2 for identification of data collection programs. 
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Table 7. Mapping of NCEO Post-School Level Personal and Social Adjustment Outcomes 
and Indicators with Select NaricHial Data Collection Programs 



1 Data Collection Programs* 




Outcomes/hidicators |] 


NLTSh 

90 


^ALSINHESI 
92 1 91 


SflflSjt 


•JSFGl 

86 


SLAESI 
92 |: 


NCS 

86-89 


CPS ] 


NHSDAl 
93 1 


MF 

94 


G1 Copes effectively with 
personal challenges, 
frustrations, and stressors 


(a) Percent of individuals who cope 
effectively with personal challen- 
ges, frustrations, and stressors 






















(b) Percent of individuals whose 
behavior reflects an acc^tance df 
the consequences for behavior (e.g., 
makes restituticxi) 






















(c) Percent of individuals who exercise 
self-control 






















G2 Has a good self image J 


(a) Percent di individuals who perceive 
themselves as worthwhile 












X 








^ 1 


(b) Percent of individuals who perceive 
themselves as competent 




















X 1 


G3 Respects cultural and I 

individual differences 


(a) Percent of individuals whose 
behavior demonstrates accqrtance of 
diversity 




















X 


G4 Gets along with other people B 


Percent of individuals who have 
friends and are a part of a social 
network 




















X B 


(b) Percent of individuals who 
demonstrate skill in interacting in 
social situations 


X 




















(c) Percent of iixlividuals who engage 
in productive group work in home, 
school, wmk, and community 
environments 






















(cO Percent of individuals who 
demonstrate skill in managing 
inteiuerscnal conflict 






















(e) Perrent of individuals who relate 
effectively to audioiity figures 




















X 


(0 Percent of individuals «bo relate 
effectively to neeis 


X 




















(g) Percent of individuals who interact 
witii parents or other family 
members on a regular basis 


X 





















Note. ”X" indicates database includes a possiUe indicator. 

*See Table 2 for identification of data coUectkxi programs. 
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Table 8 . Mapping of NCEO Post-School Level Satisfaction Outcomes and Indicators with 
Select National Data Collection Programs 





Data Collection Programs* 


Outcomes/Indicators 


NLTS 

90 


NALS 

92 


NHES 

91 


NHIS 

91 


NSFd 
86 1 


NLAES 
1 92 


NCS 

86-89 


CPS 


iNHSDA 

I 93 1 


MF 

94 


HI Individual’s satisfaction with 
hieh school exnerience 


(a) Peicent individuals who are 

satisfied with their current status and 
life experiences (e.g., general well 
being) 




















X 


(b) PercCTt of individuals who are 
satisfied with what was provided in 
postsecondary school experiences 






















(c) Percent individuals who are 
satisfied with their current 
employment experience 






















(d) Percent individuals who are 
satisfied with their current living 
arrangements 






















(e) Peicent of individuals who are 
satisfied with their social network 






















(0 Peicent df individuals who are 
satisfied with community services 
available 






















(g) Peicent of individuals who arc 
satisfied with their level, of 
involvement in leisure^ activities 






















H2 Parent/guardian satisfaction 
with current status of 
individual 


(a) Percemofparents/guardianswhoaie 
satisfied with iiidividual's current 
status fe.g.. general well being) 






















H3 Community satisfaction with 
current status of individual 


(a) Percent of cmiununity (employers, 
general public, service agency 
personnel, and policymakers) who 
are satisfied with the individual's 
current status 























Note . "X" indicates database includes a possible indicator. 

*See Table 2 for identification of data ctdlection programs. 
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Table 9 . Availability of NCEO Post-School Level Outcome Indicators in Select National Data 
Collection Programs 



NCEO Oitcome Domains 


Number of 
Indicators in 
domain 


NumbCTof 
indicators for 
which data 
maybe 
available in 
reviewed 

databases ^ 


Percent of 
indicators for 
which data 
maybe 
avail^le in 
reviewed 

databases^ 


Databases 
indicator ratio^ 


A. Pres«ice and 
Pardcipaticxi 


5 


5 


100% 


2.0 


C. Physical Health 


10 


8 


80% 


2.0 


D. Responsibility and 
Independence 


9 


5 


56% 


0.0 


E. C^ontribution and 
Cidzen^p 


4 


3 


75% 


1.0 


F. Academic and Functional 
Literacy 


13 


6 


46% 


0.0 


G . Personal and Social 
Adjustment 


13 


8 


62% 


1.0 


H. Satisfactimi 


9 


1 


11% 


0.0 


1 All NCEO Outcome 
1 Domains 


63 


36 


57% 


0.5 



I The databases that were reviewed are: National Longitudinal Transition Study of Special Education Students 
Q«.TS) 1990 FoUow-up, National Survey of Family Growth 1986 (NSFG), National Longitudinal Alcohol 
Epidemiolo^c Survey 1992 (NLAES), National Adult Literacy Survey 19^ (NALS), National Crime Survey 
1986-89 (NCS), National Household ^ucatum Survey 1991 (NHES), Current Pt^wlation Survey (CPS), 
National Health Interview Survey 1991 (NETS), National Household Survey of Drug Abuse 1993 (NHSDA), 
hfonitoring the Future 1994 (MF). 

^ This number represents dte average (median) number of data collection programs with meast^ for each 

indicate in an outcome domain. Thus, for example, diere ate an average of 2.0 data collection programs with 
measures of each indicator in the Presence and P^^dpaticm domain. 
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Discussion 

Indicators of important post-school completion outcomes for gU students are represented in 
a portion of our national data collection system. Across ten naticxial data collecticm programs that 
include individuals after they leave secondary schools, slightly over half (57%; 36 of 63) of the 
NC^O post-school outcome indicators are represented by at least one measure. When the non- 
recurring Nadcmal Longitudinal I'ransidon Study of Special Education Students (NLTS) is 
excluded, the coverage is approximately 10% less (46% of the NCEO outctxne iiidicators are 
represent^). With t^xproxinaately half of the NCEO post-school outcome indicates present in our 
recurring national data collection system, the potential exists for producing partM information 
regarding the status of all students after Aey leave school. A comparison to a similar analysis at 
the school-completion level (McGrew et al., 1994) finds that post-school indicators are less 
available than locators available at the end of school. In contrast to the 57% coverage found at 
the post-sclKX)l level, McGrew et al. found 91% coverage of the NCEO outccxne indicators at the 
school completion level. 

As would be expected given the different purposes of data collection programs, the 
availabUity of measures that ^proximate the NCEO indicators varies widely. The MF:94, 
NLTS:90, and NALS:92 data collection programs are the most promising data sets for providing 
information regarding the NCEO post-school outcome domains. However, these data sets sdU 
only provide for coverage for approximately 15% to 30% of the NCEO post-school outcome 
indicators. It is clear that analysts who seek to provide infonnation regarding the complete post- 
school NCEO model will need to draw indicators from nearly all of the t^ data collection 
programs reviewed in this study. 

The conceptual and technical problems typically encountered when comparing and/or 
merging information from difriraent data collection programs (McGrew, Spiegel, Thudow, 
Ysseldyke, Bruininks, Deno, & Shriner, 1991) will most likely make the fin^ percent of usable 
NCEO indicators less than the 57% figure reported in this investigatirai. Given the certainty that 
some of these single indicators will be unusable due to the techni^ and metibiodological problems 
encountered in secondary data analysis (McGrew et aL, 1991), the final percent of NCEO post- 
school indicators available for analysis will be under 50%. 

The databaseAndicator ratios for the different NCEO outcome domains suggest dmt the 
potential problem of unusable indicators may be most significant in the areas of Responsibility and 
Independence (0.0), Academic and Functional Literacy (0.0), and Satisfactirai (0.0), and to a 
lessor extent Contribution and C^itizenship (1.0) and Person^ and Social Adjustment (1.0). 
Outcome domains that are likely to still be represented by usable indicators after indicator attrition 
due to technical problems are I^esence and Participation (2.0) and Physical Health (2.0). 

Even if the problems in comparing and combining infcxrmation from different databases can 
be resolved, the ability to extract useful formation regar^g students with disabilities may be all 
but impossible. Students with disabilities are often missing from national data collection 
programs, and if present, they cannot be consistently identified for analysis. An investigation of 
tile exclusirxi of students with disabilities in national data collection progranu found tiiat in 
educational data sets, 40% to 50% of the population of students with di^bilities typically is 
excluded (Mc(^w, Thurlow, & Spiegel, 1993). In ncHieducational data collection programs, 
students with disabilities are included to a greater degree. However, even when present in the 
samples, ii^viduals with disabilities often cannot be identified with any consistency due to the 
lack of disalnlity-specific identifying variables or the use of different dirability categories across 
data collection programs (McGrew, Algozzine et al., 1993). 
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In conclusi<Mi, the potential exists for pioducing partial policy-relev^t infonnation on Ae 
post- school outcomes of students with disabilities. However, die potential is much less Aan that 
fijund at the school-completicKi level where a much larger number of NCEO outeM^ mmeators 
was found to be in recurring nadcxial data collection programs (McGiew et al., 1994). The bad 
news is that even this partial potential cannot be tapped currendy to analyze and gen<^ rej^rte 
about students with disabilities. The exclusion of significant numbers of students with disabilxues 
6om recurring national data collection programs and die variable or nonexistent asability-^^c 
variables used to identify students in these data collection programs makes it all but impossible to 
use all the outcome information that is currendy available at the national level. 



Recommendations 

The inaWlity to extract comprehensive national outcome irrforrnation at the school 
completion (McGrew et al., 1994) and post-school levels for students wth disabilities only 

partially due to a lack of potential indicators in our national data collection programs. The 

exclusion of ct priifirant numbers of students with disabilities from many normal data collection 
programs and the vari^le identificatiem of these studente by type of disalnlity in the» programs 
are the greatest impediments to the production of recurring naticxial reports on the school 
corrroletion status of students with disabilities. Recommendations to address diese wo ron^rns 
have been presented elsewhere (McGrevv, Thurlow & Spiegel, 1993; McGrew et al., 1992). 

However, improvements still can be made in the types of items included in national data 
collection programs. Tlie goal of these irqprovements would be to increase the breadth of 
information on all students. Individuals and organizatioiw charged with the design of nanon J data 
collection programs are encouraged to review tiie following general suggestions, many which were 
also madft by McGrew et al. (1994) when discussing the school-completion analyses. 

1 . Attention needs to be directed to the development of indicators in gjl NCEO post-school 
outcome domains. Most pressing is the ne^ to develop or employ existing (m^me 
indicators related to accepting tire consequences of one's behavior (responsibility and 
indqiendence), acadenuc airf functional literacy, personal and social adjustment, and 
sati^action. 

2. The NCEO conceptual model of outcomes should be reviewed for ideas on new outcomes 
or indicators to include in ongoing or future national studies. C^sideration needs to te 
given to the develtpment of variables to tetter measure outccMnes related to all the NCEO 
post-school outcome dexnains. 

3 . Individuals and organizations developing instrumentatUMi for natitxial data coUection 
programs should review the instruments and methodology reports of the National 
Longitudinal Transition Study of Special Education Students (NLTS) for ideas on how to 
develop new indicators or strategies for measuring important outcomes for gU students. 
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